Searching PA J 



1/1 ^— V 



PATENT ABSTRACTS OF JAPAN 



(1 1 publication number : 06-0381 1 3 

(43)Date of publication of application : 10.02.1994 



(51)Int.CI. 


H04N 5/335 




H04N 5/217 




(21 Application number : 04-213397 


(71)Applicant 


: SONY CORP 


(22)Date of filing : 1 7.07.1 992 


(72)Inventor : 


YOSHIDA MASANOBU 



(54) IMAGE PICKUP DEVICE 

(57)Abstract: 

PURPOSE: To correct automatically a defect of a CCD by detecting a 
defect of the CCD for each picture element and correcting picture 
element data corresponding to the result of detection. 
CONSTITUTION: An iris 3 is closed just after a power supply is turned 
on. Each of picture element data of a CCD 4 is read in this state and 
compared with a prescribed reference value at a comparator circuit 61. 
When picture element data to be read have a defect, the level is larger 
than a reference level set by a micro controller 31. In this case, a defect 
correction circuit 9 interpolates picture element data with one preceding 
picture element data and outputs the result. 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the 
original precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 

[Claim(s)] 

[Claim 1]An imaging device comprising: 

An imaging means which outputs image data of a photographic subject for every pixel. 

A detection means to detect a defect for every pixel of said imaging means from an output of 

said imaging means. 

A compensation means which amends image data outputted from said imaging means 
corresponding to a detection result of said detection means. 

[Claim 2]The imaging device according to claim 1 with which it has further a control means 
operated when one [ a power supply ], and said detection means is characterized by detecting 
a defect for every pixel of said imaging means whenever one [ said control means / said power 
supply]. 

[Claim 3]The imaging device according to claim 1 or 2 when it has further a control means 
which controls light volume of light which enters into said imaging means and said detection 
means detects a defect for every pixel of said imaging means, wherein said control means 
does not enter light in said imaging means substantially. 

[Claim 4]When said imaging means is further equipped with a shutter means which controls 
time for light to enter and said detection means detects a defect for every pixel of said imaging 
means, said shutter means, The imaging device according to claim 1, 2, or 3 restricting time 
when light enters into said imaging means to predetermined time. 



[Translation done.] 
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DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Industrial Application]This invention is used for a portable video camera etc., for example, and 

relates to a suitable imaging device. 

[0002] 

[Description of the Prior Art]CCD is used for the video camera as the image sensor these days. 
This CCD is considered as matrix composition, for example, 400,000 pixels are arranged. 
[0003]lf at least one of each of the pixel of this has a defect, the output corresponding to that 
pixel will serve as an unusual value. Then, before shipping a video camera from a plant, the 
defect of CCD is inspected, and he is trying to amend this. 
[0004] 

[Problem(s) to be Solved by the Invention] However, since the conventional video camera was 
what amends a defect before factory shipments in this way, when a defect occurred after 
factory shipments, it was not able to amend this. 

[0005]lt is made in view of such a situation, and enables it to amend a defect after factory 

shipments, and this invention is **. 

[0006] 

[Means for Solving the Problem]This invention is characterized by an imaging device 
comprising the following. 

CCD4 as an imaging means which outputs image data of a photographic subject for every 
pixel. 

The microcontroller 31 as a detection means to detect a defect for every pixel of CCD4 from an 
output of CCD4. 

The error correction circuit 9 as a compensation means which amends image data outputted 
from CCD4 corresponding to a detection result of the microcontroller 31. 
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[0007]This imaging device can detect a defect for every pixel of CCD4, whenever one [ it has 
further the final controlling element 37 as a control means operated when one / a power 
supply / and / the final controlling element 37 / a power supply ]. When the iris 3 as a control 
means which controls light volume which enters into CCD4 is formed further and the 
microcontroller 31 detects a defect for every pixel of CCD4, light can be prevented from 
entering into CCD4 substantially by the iris 3. When the electronic shutter 35 as a shutter 
means which controls time for light to enter into CCD4 is formed and the microcontroller 31 
detects a defect for every pixel of CCD4, Time when light enters into CCD4 by the electronic 
shutter 35 can be restricted to predetermined time. 
[0008] 

[Function]ln the imaging device of the above-mentioned composition, when the microcontroller 
31 detects the defect which is each pixel of CCD4, the output of CCD4 is amended by the error 
correction circuit 9. Therefore, a user becomes possible [ using a device ], without almost 
caring about this defect substantially. 
[0009] 

[Example] Drawing 1 is a block diagram showing the composition of one example of the video 
camera adapting the imaging device of this invention. It is made as [ enter / the light from a 
photographic subject / into CCD4 / via the lenses 1 and 2 ]. The iris 3 is arranged among the 
lenses 1 and 2, and it is made as [ control / the light volume of the light which enters into 
CCD4 ]. The pixel [ a large number (for example, 400,000 pieces) ] is arranged on the matrix, 
and CCD4 is made as [ output / for every pixel / the image data of a photographic subject ]. 
The electronic shutter 35 is made as [ control / the time (exposure time) when light enters into 
this CCD4 ]. 

[0010]After sample hold of the output of CCD4 is inputted and carried out to the sample hold 
circuit 6 via the amplifier 5 and also an A/D conversion is carried out by A/D converter 7, it is 
made as [ supply / the digital disposal circuit 8 and the zone detector circuit 21 ]. 
[001 1]The digital disposal circuit 8 is made as [ output / amend this and / it / to the circuit which 
is not illustrated / as luminosity (Y) data and color difference (C) data ], if the image data which 
has the error correction circuit 9 and was inputted from A/D converter 7 has a defect. The 
output of the error correction circuit 9 is made as [ supply / via the data bus 10 and the shift 
register 11 as an interface / the microcontroller 31 which consists of microprocessors etc. ]. 
[0012]The inside of the image data into which the zone detector circuit 21 was inputted from 
A/D converter 7 on the other hand, The image data of selection and a ** zone is added in the 
adding machine (integration circuit) 23 by the selection circuitry 22, and it is made as [ output / 
the data added (integration) / to the microcontroller 31 / via the shift register 24 ]. It is made as 
[ choose / the zone added in the adding machine 23 corresponding to the instructions inputted 
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via the shift register 25 / from the microcontroller 31 / in the selection circuitry 22 ]. 
[0013]The final controlling element 37 is constituted by a switch, button, etc., and when 
switching on a power supply or inputting predetermined instructions, it is operated. The 
microcontroller 31 is made as [ control / corresponding to this operation / each part ]. For 
example, when ordered in adjustment of the iris 3, the motor 33 drives via the amplifier 32 and 
the iris 3 is adjusted to a predetermined diaphragm value. When ordered [ using the electronic 
shutter 35 and ], the electronic shutter 35 drives via the timing generator 34, and it is made as 
[ control / exposure time ]. 

[0014]This timing generator 34 has memorized the address for every pixel of CCD4, and when 
the defect of a predetermined pixel is detected by the microcontroller 31, it is made as 
[ output / to the error correction circuit 9 / an error correction tab-control-specification pulse ]. 
While the sync generator 36 generates various sink signals and outputting to the timing 
generator 34, The sampling tab-control-specification pulse which samples the data of a 
predetermined pixel corresponding to the instructions from the microcontroller 31 is outputted 
to the data bus 10, and it is made as [ make / the microcontroller 31 / supply the picture 
element data specified by this designation pulse via shift REJITA 1 1 ]. 
[0015]Next, the operation is explained with reference to the flow chart of drawing 2 and 
drawing 3 . When the one [ a power supply ] by operating the predetermined switch of the final 
controlling element 37 that the video camera shown in drawing 1 should be used, the 
microcontroller 31 starts the processing shown in drawing 2 . The microcontroller 31 makes the 
iris 3 first closed in Step S1. Thereby, light will be in the state where it does not enter at all 
CCD4. Next, it progresses to Step S2 and processing of the subroutine of a defective search is 
performed. The details of processing of the subroutine of this defective search are shown in 
drawing 3 . 

[0016]That is, the microcontroller 31 sets the zone counter to build in to a predetermined initial 
value (for example, 1) first. Next, it progresses to Step S12 and it is judged whether the value 
of the counter set at Step S1 1 has reached the last value of the zone (were all the zones of the 
screens of one sheet judged or not?). When the judgment of all the zones is completed, a 
return is carried out to Step S2. When no detection processing of zones is completed yet, it 
progresses to Step S13, and the picture element data in the zone is added in the adding 
machine 23 (integration). 

[0017]Namely, although the data for one screen is serially inputted into the adding machine 23 
one by one from A/D converter 7, Corresponding to the instructions which the microcontroller 
31 supplies via the shift register 25, the selection circuitry 22 chooses a zone predetermined 
[ of this one screen ], and outputs only the picture element data in that zone to the adding 
machine 23. In the example of drawing 1 , one screen is classified into nine zones, and the 
picture element data of one of these nine zones will be supplied and added to the adding 
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machine 23. 

[0018]And it is judged whether a defect exists in the pixel of the zone from the picture element 
data which he followed to Step S14 and with which it integrated in Step S13 from Step S13. 
That is, the microcontroller 31 receives supply of the aggregate value (integral value) of the 
predetermined block which the adding machine 23 added via the shift register 24, and 
compares this aggregate value with the predetermined reference value set up beforehand. 
[0019]Since the iris 3 is changed into the state where it closed thoroughly, now as mentioned 
above, the level of the image data which CCD4 outputs will become near 0 substantially. 
However, if this CCD4 has a defect, that output level will not be set to 0. As a result, when 
there is no defect into the zone, an aggregate value turns into a value smaller than the 
reference value set up beforehand, but when there is a defect, it becomes larger than a 
reference value. The microcontroller 31 performs this judgment. 

[0020]And when judged with a defect not existing, it progresses to Step S15, and only 1 
************** s a ZQne counterj jt returns to Step S1 1, and processing after it is repeated. That 
is, when a defect does not exist in the zone shown by the number 1 , for example in drawing 1 , 
processing of the zone shown by the number 2 is used henceforth. And when a defect does 
not exist in the zone shown by the number 2, processing of the zone shown by the number 3 is 
used henceforth. 

[0021 ]ln Step S14, when judged with the target zone having a defect now, it progresses to 
Step S16, and H counter is set to a predetermined value. Furthermore it progresses to Step 
S17, and V counter is set to a predetermined value. And in Step S18, processing which 
extracts the picture element data specified by H counter set up at Steps S16 and S17 and V 
counter is performed. Thereby, the predetermined data currently held at the data bus 10 of the 
digital disposal circuit 8 is supplied to the microcontroller 31 via the shift register 11. 
[0022]lt judges with the microcontroller 31 having a defect as compared with the 
predetermined reference value beforehand set up in the level of this predetermined pixel, when 
that level is larger than a reference value, and when small, it judges with there being no defect. 
When there is no defect, it progresses to Step S20, and only one H counter is ************** e d. 
And it progresses to Step S21 and only 1 ************** s v counter. And it progresses to Step 
S16 again, and processing after it is repeated. As a result, it will be judged whether it is the no 
which has a defect in the following pixel. 

[0023]Namely, in the case where it judges with the microcontroller 31 having a defect in the 
zone with which it integrated in the adding machine 23, A sampling tab-control-specification 
pulse is supplied to the data bus 10 via the sync generator 36, and the operation which reads 
one picture element data of the target zone at a time via the shift register 1 1 is repeated. In the 
digital disposal circuit 8, each picture element data is serially inputted from AID converter 7. 
Therefore, the digital disposal circuit 8 can supply only one picture element data to the 
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microcontroller 31 in the 1 field. Then, the picture element data contained in the zone will be 
read over the time of the field number for the number of the pixel in each zone, and the 
existence of the defect will be judged. 

[0024]ln this example, the number of the picture element data which can be read from the 
digital disposal circuit 8 in this way will be only one piece about the 1 field. Then, he is trying to 
judge the position for every pixel only about the zone judged as there being a defect by 
classifying one screen into two or more zones, as mentioned above, and judging whether there 
is any defect beforehand for every zone. By doing in this way, it is begun to read each picture 
element data one by one, without classifying one screen into a zone, and quick processing is 
attained compared with the case where the existence of a defect is judged. 
[0025]ln Step S19, when judged with one pixel read now having a defect, it returns to Step S2. 
And when this defect is detected, it progresses to Step S3 further, and processing of error 
correction is performed. That is, while memorizing the pixel judged as the microcontroller 31 
having a defect to RAM31a to build in, the timing generator 34 is controlled and the error 
correction tab-control-specification pulse which specifies the pixel judged as there being a 
defect is made to supply to the error correction circuit 9. The error correction circuit 9 
complements and outputs the picture element data of the position specified by that designation 
pulse with the picture element data of one piece ago, when this designation pulse is inputted. 
[0026]Next, it progresses to S4 from Step S3, and checking operation is performed. That is, 
the microcontroller 31 makes the picture element data of the zone where the defect was 
detected by the data bus 10 now via the sync generator 36 choose again. And it is judged 
whether as compared with a reference value, there is any defect again about the value. When 
still judged with there being a defect, it progresses to Step S5, and a timer check is performed. 
And when the time set up beforehand has not passed yet after one [ progressing to Step S6 
and / a power supply ], it progresses to Step S2 and processing after it is repeated. That is, 
repeat execution of the compensation process of a defect is carried out until the time set up 
beforehand passes, after one [ a power supply ]. 

[0027]As a result of checking in step S4, when [ which was judged ] the defect is amended, 
and when it is judged with the time set up beforehand having passed in Step S6, progress to 
the following step S7, the iris 3 is made to open wide, and compensation process operation is 
terminated. 

[0028]Although the image data of one screen (1 field) is divided above in two or more zones 
and the existence of the defect was judged for every zone, For example, all the picture 
element data of the whole 1 screen is added (integration), and still finer detection processing 
can be performed corresponding to the comparison result, comparing this with a 
predetermined reference value. If it does in this way, when a defect does not exist, processing 
can be completed promptly. 
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[0029] Drawing 4 shows the composition of the 2nd example of this invention. The digital 
disposal circuit 8 is constituted by the signal processing part 50 and the defect detector 60 in 
this example. When a defect detection signal is inputted as the delay circuit 51 which the 
signal processing part 50 does the specified time lag of the data inputted from A/D converter 7 
in addition to error correction circuit 9 and data bus 10, and is supplied to the error correction 
circuit 9 from the defect detector 60, It has RAM52 which memorizes position data when 
supplied from the timing generator 34. The defect detector 60 has the comparator 61 which 
compares the data supplied from A/D converter 7 with the reference value supplied via the 
shift register 62 from the microcontroller 31. 

[0030]Other composition is the same as that of the case in the example of drawing 1 . 
[0031]Next, the operation is explained with reference to the flow chart of drawing 5 . One of a 
power supply will also start this processing. The microcontroller 31 controls the motor 33 via 
the amplifier 32, and makes the iris 3 first closed in Step S31. Next, it progresses to Step S32 
and a predetermined reference value is made to set to one input of the comparison circuit 61 
via the shift register 62. Furthermore it progresses to Step S33, and automatic error correction 
mode is made to set up. That is, when a defect has a pixel which does not have a defect when 
error correction processing is performed in the mode in which the usual picture is outputted, 
there is a possibility that an erroneous decision may be carried out. Then, the special mode for 
detecting a defect is set up. 

[0032] Next, progress to Step S34, and the speed of the electronic shutter 35 is made to set to 
predetermined time (comparatively high-speed time), and the compensation process of real 
time is performed. That is, the microcontroller 31 controls the electronic shutter 35 via the 
timing generator 34, and makes the electronic shutter 35 perform comparatively high-speed 
operation (operation which makes exposure time brief). It was checked as a result of the 
experiment that it becomes easy to detect a defect from the output of CCD4 to have controlled 
the electronic shutter 35 to become comparatively short exposure time. 
[0033]On the other hand, in Step S34, error correction operation is further performed in real 
time. That is, the data which A/D converter 7 outputs is compared with the reference value 
(this reference value is set up in Step S32) set up via the shift register 62 in the comparison 
circuit 61 . 

[0034]As mentioned above, as for the data of the pixel with a defect, the level has become 
larger than a reference value. When the detecting signal which shows that a defect exists from 
the comparison circuit 61 is inputted, RAM52 judges the position corresponding to it from the 
position data which the timing generator 34 outputs, and memorizes the position data. After the 
delay circuit 51 is delayed in the data in which only processing time required for detection of a 
defect was outputted from A/D converter 7, it is outputted to the error correction circuit 9. When 
the timing signal which should amend from RAM52 is supplied, the error correction circuit 9 
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keeps the picture element data inputted from the delay circuit 51 with the picture element data 
in front of one, and outputs it to the data bus 10. 

[0035]Thus, in this example, since the picture element data read from CCD4 is made as 
[ amend / for every pixel, / if there is a defect in real time ], when the judgment about all the 
picture element data of CCD4 is performed once, a compensation process will be completed. 
That is, in this example, a compensation process will be completed by the reading time of the 1 
field. 

[0036]When such a compensation process is completed, next it progresses to Step S35, the 
iris 3 is opened wide, and compensation process operation is ended. 

[0037]After a compensation process is performed as mentioned above, it will be switched to 
the usual mode and the usual image data will be outputted. As a result, since the picture 
element data of the pixel 4a which has a defect, for example is replaced and outputted to 
picture element data without a defect, a defect is prevented from being recognized by the user. 

[0038] In this example, although it was made to make RAM52 memorize a corrected position, 
of course, it may be made to make RAM31a of the microcontroller 31 memorize. 
[0039]ln the above two examples, although it was made to perform a compensation process 
immediately after one [ a power supply ], when this switch is operated by forming the switch for 
exclusive use operated when starting a compensation process to the final controlling element 
37, it is also possible for it to be made to perform a compensation process. However, since 
operation in which it was made to make it more nearly special [ to perform a compensation 
process automatically ] becomes unnecessary when one [ a power supply ], operativity 
becomes good. 
[0040] 

[Effect of the lnvention]Since the defect for every pixel of an imaging means is detected and 
picture element data was amended corresponding to the detection result according to the 
imaging device of this invention like the above, the compensation process at the time of factory 
shipments becomes unnecessary. 



[Translation done.] 
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DESCRIPTION OF DRAWINGS 

[Brief Description of the Drawings] 

[Drawing 1] lt is a block diagram showing the composition of one example of the video camera 
adapting the imaging device of this invention. 

[Drawing 2] lt is a flow chart explaining operation of the example of drawing 1 . 
[Drawing 3]lt is a flow chart which shows detailed processing of Step S2 of drawing 2 . 
[Drawing 4] lt is a block diagram showing the composition of the 2nd example of the video 
camera adapting the imaging device of this invention. 

[Drawing 5] lt is a flow chart explaining operation of the example of drawing 4 . 
[Description of Notations] 

3 Iris 

4 CCD 

8 Digital disposal circuit 

9 Error correction circuit 

10 Data bus 

1 1 Shift register 

21 Zone detector circuit 

22 Selection circuitry 

23 Adding machine 
31 Microcontroller 

34 Timing generator 

35 Electronic shutter 

37 Final controlling element 
50 Signal processing part 

60 Defect detector 

61 Comparison circuit 
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62 Shift register 
[Translation done.] 
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DRAWINGS 



[Drawing 1] 




B 5 l~ 37 



[Drawing 2] 
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[Drawing 4] 
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